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1. Introduction 

Let X be a random vector in M. k such that 

Af:=Ee AeX <oo (1.1) 

for some unit vector e S R fc and some A £ (0,oo); here the juxtaposition ex 
denotes the Euclidean scalar product of vectors e and x in R fc . By Chebyshev's 
inequality, the exponential integrability condition (|1.1|) implies the tail estimate 

P(eX ^ x) ^ M e~ Xx for all x e K. (1.2) 

Vice versa, for any given Ao G (0, oo] one has the following: if (|1.2)l holds for 
each A 6 [0, Ao) and some M — M(A) 6 (0,oo), then Ee AeX < oo for each 

Ae[0,A ). 

Suppose also that (the distribution of) X has a density p (relative to the 
Lebesgue measure) such that, for some fi € [0, A) and some C € (0, oo), 

p(x) ^ C*e^ ex for all x e K fc . (1.3) 

Note also that, if \i = 0, then condition (|1.3| simply means that the density p 
is bounded. 

If p is varying regularly enough in an appropriate sense then, given the con- 
dition (jl.ip . one will have (|1.3|) for /i = A; that is, one will have an exact "local" 
counterpart to the "integral" upper bound (|1.2p . The difference 

£ := A — n 

(between the largest possible A and \x for which (jTTTJ) and (|1 .3[) will still hold) 
may therefore be referred to as the (exponential) "deficiency" of the density p, 
which is a measure of its irregularity. 

The main result of this paper implies that the deficiency decreases fast under 
convolution: starting with condition (|1.3p for p with /i = A — e, one has this 
condition for the n-fold convolution p* n (in place of p) with fi = A — e/n; that 
is, for the n-fold convolution, the deficiency is n times as small as the original 
one. More generally, it is proved that, for any probability densities p\, . . . ,p n on 
IR fe satisfying the exponential integrability condition with the same A and with 
respective deficiencies e±, . . . , e n , the deficiency of the convolution Pi * ■ ■ ■ * p n 
is no greater than e"/n, where stands for the harmonic mean of the original 
deficiencies e\, . . . ,e„. Moreover, it is shown that this bound, e^/n, cannot be 
improved. 

2. Statements of the results 

Let Xi , . . . , X n be any independent random vectors in M. k , with densities p±, . . . ,p, 
Assume the following conditions: 

Mi := Ee AeXl = ( e Aex p,(x)dx < oo (2.1) 
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and 

Pi(x)<ae- wex (2.2) 

for some Cj's in (0, oo), some /Vs in [0, A), all i £ {1, . . . , n}, and all x e M fe . 
Consider the convolution 

P {n) ~Pi*---*Pn, (2.3) 
which is the density of the sum Xi + • ■ ■ + X„. 

Theorem 2.1. There exists a finite constant K ni which depends only on the 
numbers n, A, fa, Mi, and C,*, such that 

p (n) (x) < if„e- (A - £<,l))ex /or aZZ x e R fe , (2.4) 

where 

e {n) := r and e. t := A — fa > 0. (2.5) 

~ ' ' ' ~ 
The necessary proofs will be given in Section 01 

Note that e^ n ' — e^/n, where e" denotes the harmonic mean of Ej.,. .. ,e n . 
One may also note that < min(ei, . . . , e„). 

It turns out that the coefficient A — e^ n ' in the exponent in the bound (|2.4p 
is the best possible: 

Proposition 2.2. For any natural k and n, any A € (Q,oo), and any fa 's in 
[0, A), the estimate [|2.4p u«ZZ fail to hold if the number e^ n ' given by (|2.5| is 
replaced by any smaller number. 

From Theorem 12. 1\ one immediately obtains the particular "i.i.d." case: 

Corollary 2.3. If conditions (jl.ip and (II .3[) ZioZd, then for each natural n there 
exists a constant K n , which depends only on the numbers n, A, fa M , and C , 
such that 

p*"(x) < K n e - {x - e/n] ex for all x e R k , (2.6) 

where e := A — /t. 

It follows from Proposition 12.21 that the coefficient A — e/n in the exponent 
in the bound (|2.6[) is the best possible. 
In turn, Corollary 12.31 yields 

Corollary 2.4. If conditions (II. ip and (jl.3p ZioZd, then for eacht <E (0, A) i/iere 
exists a natural number n t such that for all natural n n t £/ie n-fold convolution 
Pt n of the t-tilted density 

ftto^T^ (xGR fc ) (2.7) 

zs bounded. 

In fact, in Corollary 1 2 . 41 one may take n t = |"x^rl- 
Corollary 12.41 can be rewritten as 
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Corollary 2.5. If conditions and (|1.3p /ioZd, then for eacht €E (0, A) £/iere 

exists some 74 G (0, 00) smc/i £/iaf /or a^Z 7 ^ 7t 



where /t(s) := J Rfc e isx pt(x) dx, i/ie characteristic function of the t-tilted density 
pt; here, of course, i stands for the imaginary unit. 

Remark 2.6. In applications, one may of course assume the "grouping": Xj = 
Y TOj _ 1+ i + • • • + Y m . for j = 1, ... , 71, where = m < mi < . . . and the Y's 
are independent random vectors, whose distributions may themselves not have 
a density. Then the densities p\, . . . , p n as in Theorem 12.11 will be the densities 
of the convolutions of the distributions of the corresponding Y's. 

3. Discussion 

The condition of the boundedness of the n-fold convolution p\ n of the tilted 
density p t or, equivalently, the condition (|2.8|) of the absolute integrability of 
the corresponding "tilted" characteristic function is needed to derive saddle- 
point approximations. Surveys of literature on such approximations are given 
e.g. in [3l[9]; for more recent work see e.g. [5]fT0], 

In the context of saddle-point approximations, the tilting is sometimes de- 
scribed as imbedding the original density p into the exponential family (|2.7|) . 
The condition of the boundedness of p\ m for all relevant values of the tilting 
parameter t and all large enough m appears to be usually imposed outright; see 
e.g. Barndorff-Nielsen and Cox [TJ page 298, condition c]; Lugannani and Rice 
page 481, condition (ii)] impose an even stronger condition, requiring (for 
k = 1) that \f t (s)\ = 0((1 + NT 7 ) for some 7 > and all set. 

On the other hand, Corollaries 12.41 and 12.51 together with Remark 12.61 show 
that one need a priori require the boundedness of p* m only for t = and 
some natural to, that is, only for some convolution p* m of the original, un-tilted 
density p; then p™ will necessarily be bounded for all t in the interval [0, A) 
and all large enough m. 

The considerations presented above in this section constituted the original 
motivation for the present work. The proof of Proposition ^. 21 (given in the next 
section) shows that probability densities with the deficiencies most resistant to 
convolution are mixtures of infinitely many mutually (almost) singular densities, 
spaced regularly enough (see Fig. Q] on page [7]). Such "exponentially deficient" 
distributions can be contrasted with the well-studied classes of regualrly behav- 
ing distributions with nearly exponential tails; see e.g. [Il[6j[8]. 

4. Proofs 

Proof of Theorem \2.1\ To begin, note that for n — 1 the inequality (|2.4[) with 
Ki := C\ is the same as (|2.2|) . Next, a trivial remark is that (|2 . 1 [) implies 




(2.8) 
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Ee Ae(x 1 + - +x„_ 1 ) _ Mi . ,.M n _i < oo. Note also that J23J) can rewritten in 
an additive form, as 

1 1 1 

7^ ~ 7l + " ' + 

So, by induction, it suffices to prove Theorem 12. ll for n = 2. For such a case, 
let us simplify the notation by writing p and q instead of p\ and p2, M and N 
instead of M\ and M2, C and D instead of C\ and C2, /i and instead of [i\ 
and /it2, and e and 5 instead of e\ and £2- 

Next, without loss of generality, e=(l,0,...,0)GK fe . Then, identifying any 
vector xel' with the corresponding pair (x,y) G M x ]R fc_1 , one has ex = x, 
so that (12.211 can in this case be rewritten as 



p(x,y) < Ce-i" and g(a, y) < D e~ vx (4.1) 
for all (x,y) G M x M fe_1 . Also, conditions (j2~Tj) imply 

/>oc />oo 

/ dtip(u)<Me" Al and / duq(u) ^ N e' Xx (4.2) 

./ x J X 

for all £ G R, where 

p(ti) := / dvp(u, v) and := / dvg(u, v) 

for all u G R, the densities of the random variables eXi and eX2, respectively. 

Fix now any (x, y) elx M fe_1 . Take, for a moment, any a G (0, 1) and let 
/3 := 1 - a. Then 

(p*q)(x,y) = du civ p(x - u,y - v) q{u,v) ^ D I x + C I 2 (4.3) 

JR JR k - 1 

by (flTTj) , where 

/• />aa; 

dwp(a; — it) e~"", 



dw / dvp(x — u, y — v) e~ uu = 

-oo Jl*- 1 
/■oo /• /.pi; 

/ du / dvp(x — u, y — v)q(u, v) = / dz q(x — z) e^^ z 

Jax JRk- 1 J-oc 



Next, in view of 

pax 

h= I dup{x-u) \ udze-"* (4.4) 

Li 

dup(x~u)-\- / i/dze _t/2 / dup(x-u) 



(XX 

v dz e~ 



ax p oo /"OO /*oo 

z/dze _zy2: / diyp(iy) + / udze~ uz \ dwp(w) 

— oo J x—z J ax J (l — a)x 



ax 



SC / i/dze"^ M + / f dz e~ vz M Q~^^~ a ^ x 



M -A- e -(A-(A-")«X (4.5) 



imsart ver. 2005/05/19 file: arxiv.tex date: May 18, 2009 



losif Pinelis/ 'Deficiency of convolutions of densities 



6 



Note that this derivation of the upper bound (|4.5j) on I\ is valid only for v ^ 0. 
However, if v = 0, then 

/ax poo 
dup(x-u)= Azp{z)^Me~ x{1 - a)x , 
-oo (1 — a)x 

so that the bound (|4.5j) on 7i holds for ^ = as well. Recall now that e = A — pi 
and <5 = A — v : and choose a := ^tj. Then (|4. 5[) can be rewritten as 

Ji <Af^e-( A - £(2> )-, (4.6) 
o 

with — j^pj = r/g^jTg i in accordance with the definition (|2.5[) of e™. Quite 
similarly, 



A 



I 2 ^ N - e~ (A - £ >x . (4.7) 
e 

Collecting now (|4.3[) . (|4.6p . and (|4.7[) . one sees that 

(p*?)(x,y) <X 2 e- (A - £<2)) * (4.8) 

for some constant K 2 depending only on A, pi, M, N, C, and D, and for all 
(x,y) eRx R fe_1 . Thus, Theorem 12. II is proved for n = 2 and, thereby, for all 

natural n. □ 



The proof of Proposition [2721 rests on Lemma |4~T1 below . To state the lemma, 
for any A G (0, oo) and e G (0, A] introduce the class Vx, e of all probability 
densities p on K such that 

(i) J R e Aa; p(;r) da; < oo and 

(ii) p{x) ^ cpA lE , K ,a(s) for some c € (0,oo), k G (0, oo), a G (^,oo), and all 
x G R, where 

OO 

j——oo 

Wj(x) := Wj. x ^^ a {x) := ^ f jtRe -e\ s \ [x), (4.10) 
e - A lil 



/ a , 6 (x):=^(^), ¥>(«):= -7= 



of course, / Q ,{, is the density of the normal distribution with mean a and 
variance b 2 . 

(One could similarly, and even a little more easily, deal with the "asymmetric" 
version of the class V\, E , having Yl'jL-oa in (|4.9[) replaced by J^L .) 

Lemma 4.1. Take any A G (0, oo), e G (0, A], k G (0, 00), and a G (^, 00). 
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(I) There exists s ofYie c,\ i£ ^. a *E (0, oo) such that p\ 7 s.K 7 a '• — — > ~^~ 

In particular, it follows that V\, e 7^ 0. 
(II) There exists some C — C\_ £iK _ a G (0, 00) such that for p — Pa.s.k.q and 
fi := A — e 

p(x)^Ce-^ x forallxeR. (4.12) 

(III) For any p G V\, e and any C G (0, 00) , relation (|4.12[) does not hold with 
any /i° € (A — e, 00) in place of p,. 

(IV) In addition to e, take any 8 G (0, A]. Then, for any p G V\, s and q G V\^, 
one has p* q G V\i, where 



1 eS 



i + i e + 5' 

e a 



(4.13) 



The (symmetric about 0) probability density p\, e , K , a as in part (I) of this 
lemma is illustrated here: 




Fig 1. Graphs {(x,p(x)): < x < 7.5} and {(x, lnp(x)) : < x < 7.5} for p = p\ e K a with 
A = 0.55, £ = 0.50, K = 0.9, and a = 0.6 



Let us postpone the proof of Lemma [4.U which is somewhat long, and proceed 
now to the proof of Proposition ^. 21 

Proof of Provosition \2.c\ Take indeed any natural k and n, any A G (0, 00), 
and any jix, . . . , fi n in [0, A). In accordance with (12. 5|) . let := A — /ij, so that 
e, G (0, A] for all i = 1, . . . , n. For each i — 1, . . . , n, take any density q$ G Px.ej 
such that 

9,W<C,e-^ (4.14) 

for some finite positive real constant Ci and all x G K; by parts (I) and (II) of 
Lemma B~Tl such qi's do exist. 

As in the proof of Theorem 12. 1[ let e = (1, 0, . . . , 0) G M and identify any 
vector x G M fc with (x,y) elx R fe_1 . Then, for each i = 1, ...,n, introduce 
the densities 

Pi(x) = Pi(x, y) := qi(x)(p k -i (y) (4.15) 
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for all x = (x,y) G R x R fc_1 . where tp k -i(y) := (2n)- ( - k - 1 ^ 2 e~ yy / 2 for all 
y G R k ~ 1 ; then 



< oo, 



f e Aex ft(x)dx = f e Xx qi (x)dx 

since qt G 7\ ei ; also, by (|4.14[) , 

K (x) = gi(a:) Vfc _i(y) < ^Tr)-**" 1 */ 3 9i (x) < C^-^ 

for all x = (x,y) G R x M fc_1 . So, conditions fl2J]) and (J23I> hold. 
Next, introduce 

(n) 

so that, by ([23]) and (|4TT5]> . 

P (fl) W =p (n) (^y) = q (n HxM-i(y) (4.ie) 

for all x = (x,y) G R x R fe_1 . Moreover, recalling the conditions qi G T^A.e; for 
i = 1, . . . , n and using part (IV) of Lemma l4.ll by induction one concludes that 

Now, to obtain a contradiction, assume that (|2.4p holds with some "defi- 
ciency" e° in place of such that e° < eW. Then, by I^l6|) . for ^° := A - e° 



» 



for some constant if„ and all iel. But this contradicts part (III) of Lemma l4.1i 
since ^ G (A-eW,oo), G 7\ £ c„), and ^™ x (0) = (27ro)~ (fe ~ 1)/2 > 0. This 
concludes the proof of Proposition 12.21 except that one still needs to prove 
Lemma [Ol □ 



Proof of Lemma \4-1\ 

(I) Obviously, p\,s :K ,a > and CA, e ,K : a := J R Px,s^,a( x ) dx = YljL-oo w j < 
oo for any A G (0, oo), e G (0, A], K G (0,oo), and a G (|,oo). So, p\^. K , a is a 
probability density. Moreover, 

/ e Xx PX:E ^ a (x) dx = V exp(Aj+iA 2 K 2 e- 2e|j| ) ^ V 6 < oo. 

(4.17) 

Thus, part (I) of Lemma l4.1l is verified. 

(II) Note that 

1 p -(A-e)b'| ^ _ ~\2 2e|j| 

W,(x) = — ^= - exp- ^ . (4.18) 

Hence and because e G (0, A], one has P x, e , K , a (x) < C :— J2JL-oo Wj'O') < 00 
for all x G R. So, _pa, £:K , q (x) < Ce^ 1 for all x G (-00, 0]; that is, gllgD holds 
for p = pa,£,k,o, M = A — e, and all x G (—00, 0]. 
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Take now any x G (0, oo). Introduce j x :— [x\ , so that ^ j x ^ x < j x + 1 
and for j ^ j x one has \ j\ = j > x — 1. Then, in view of (|4.18|) . 

00 00 -{X-e)(x-l) 00 -i 

£ *r jW < £ < — jjj- £ . c, e -(->- ; (4.19) 

in this proof of part (II) of the lemma, let Ci,C2,... denote finite positive 
constants depending only on A,e, n,a. Next, for r x :— ^k^/2(A — e)x 1 and 
j £ (— oo,j x — r x ], one has a; — j ^ r x , whence 

£" Wi(x) < ^-(j) exp ^ c 2 exp < c 2 e -(*-">». (4.20) 

j=— oo J=— oc 

Further, for j G [j x — r x + 1 , j x — 1] one has x — j^l and \ j\ ^ j j T — ?' x + 1 > 
a; — fx f — C3 , whence 

j 1 e 2e(x-r x ) e e(x-2c a ) 



^ W M) ex p — ^72— < c4ex p 



2k 2 " ~* 2k 2 

s$ c 5 e-( A - £ ^. (4.21) 

So, by gU), p~T9|) . (j4~20l) . and g^B), the relation (j4~T2| (with /x = A-e) holds 
for p — p\. £ ,K,.a and all x £ (0, 00) as well. This completes the verification of 
part (II) of the lemma. 

(III) Take any p G V\.e, so that p ^ cpA,e,n,a for some c € (0,oo), n £ 
(0, 00), and a G (i, 00). Then 

poo ^ c PA , e ,«,«(j) > cWfC?) = -4= rJl S > Ce ^ j 

K\/ 111 (J + 1) 

for any fjf £ (A — e, 00), any C G (0, 00), and all large enough natural j. This 
proves part (III) of the lemma. 

(IV) Take any p £ V\. e and q £ V\.s, so that p ^ cpa, e ,k,q and q ^ epA,5,£,/3 
for some c G (0, 00), k £ (0, 00), a £ (|,oo), c G (0, 00), £ G (0, 00), and 
6(1,00). 

Choose for a moment any m £ {0,1,...} and let 



S 

m- 



- and j m := m—^— =m-i, (4.22) 
e + J e + 

so that rn-^g — 1 ^ ? TO Sj m-^j-g and m-^g ^ j m ^ m j^pj + 1- Next, introduce 



a m := ^e-aeli™! + ^2 e -2i|j m | _ ^2^2^ + ^2 e -2« m) 

C := V^+^e- 25 , C := \A 2 e 2e +£ 2 , 
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and observe that 



- < e evS 



a 2 m > k 2 exp { - 2em — -} + £ 2 exp { - 26 (m + lj } = C 

a 2 n < k 2 exp { - 2e (m - l) } + £ 2 exp { - 25m -J-J = C 



2 -2em 



where e is as in (|4.13p . Also, recall that here m ^ 0, i m ^ 0, and j m ^ 0. It 
follows that for all x S R 

/, , M \ f i \ 1 (ir-m) 2 

i/i ra ,Ke-«Kml * Jj m ,Se-sUml)(x) = } m ,crlS X > = 7k= CX P 

<7 m V Z7T £(T m 

> fm,Ce-^{x) ^ jf m (e -g m (x) ^ e~ (eVA) / m Ce -c| m |(a;). 

C771 C 

Quite similarly (or by symmetry), one has 

for any m G {—1,-2,...}, letting now i m := —i— m = \m-^g~\ and j m :— 

-j-m = |_ TO 5+rj J ' so that sti11 im + J™ = m - 

On recalling the conditions p > cpA,e, K ,a, 9 ^ cp\^,^,fi, (|4.9p - (|4.1ip , and 
(|4~22| . it follows that 



m— — oo 

OO 

^ C l W i™;A,aW im;A ,/3/ miCe -f| m | 

TM — — OO 

OO 



771— — OO 



where ci and C2 are strictly positive constants depending only on A, e, 5, n, £, a, /3. 

Also, J R e Xx (p * q)(x) dx = J R e Aa: p(a;) da; J R e Xx q(x) dx < oo. Thus, it has 
been shown that p* q £ V\^. This completes the verification of part (IV). The 
lemma is now completely proved. □ 

e tex p* n (x) 
(Ee* eX ) l; 

x e R fe . □ 



Proof of Corollary \2.4\ This follows because p* t n {~x) = /n teX N„ for all 



Proof of Corollary {EE Take any t £ (0, A). Then, by Corollary O p* t nt is 
bounded by some constant K < oo. Then, by the Plancherel isometry (see e.g. 
[2, Theorem 4.2]), for all 7 > 2n t 



f |/ t (s)Pds</ \f t (s)\ 2nt ds=(27r) fe / pr t (x) 2 dx^(2^) fc X 



< OO. 
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Vice versa, assume that (|2.8|) holds for all 7^7*; then p* t n is bounded for all 
natural n ^ 74 by the Fourier inversion formula (see e.g. [21 Theorem 4.1(iv)]), 
since the characteristic function of p* t n is / t (s)™. □ 

Remark 4.2. Weaker results than the one given by Theorem 12. ll or even Corol- 
lary 12.31 (but which still be enough to deduce Corollaries 12.41 and 12. 5|) can be 
obtained more simply modulo the Plancherel isometry. Indeed, if conditions 
(fTTTjl and CE3]) hold, then 

/ |/ t (s)| 2 ds = (27r) fe / p t (x) 2 dx = (2 t ^ / e 2te >(x) 2 dx<oc 

for t = A - e/2 and e := A - /i, since e 2 ( A - £ / 2 > ex p(x) 2 < Ce Aex p(x) for all 
xel Also, by the Fourier inversion formula, again with t = A — e/2, 

p* 2 (x) < {2Tr)- k J |/ t (s)| 2 ds < 00 for all x e M fe , 

which yields (|2.6p for n = 2. Thus, by induction, one can obtain (|2.6p for n = 2 J ', 
where j is any natural number. 

However, it is unclear whether such an approach, via the Plancherel isometry, 
could be extended to yield Theorem 1 2. II or. at least, Corollary [23] for all natural 
n. Anyway, it might be not worthwhile to exert efforts in such a direction, as the 
direct probabilistic proof of Theorem 12.11 given above is rather simple already 
and yet produces the best possible bound on the exponential deficiency. 
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